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ABSTRACT 



Embedding information into multimedia data is a topic that has gained increasing attention recently. For video 
broadcast applications, watermarking of video, and especially of already encoded video, is interesting. We present 
a scheme for robust interoperable watermarking of MPEG-2 encoded video. The watermark is embedded either 
into the uncoded video or into the MPEG-2 bitstream, and can be retrieved from the decoded video. The scheme 
working on encoded video is of much lower complexity than a complete decoding process followed by watermarking 
in the pixel domain and re-encoding. Although an existing MPEG-2 bitstream is partly altered, the scheme avoids 
drift problems. The scheme has been implemented and practical results show that a robust watermark can be 
embedded into MPEG encoded video which can be used to transmit arbitrary binary information at a data rate 
of several bytes/second. 

Keywords: watermarking, Wdeo, MPEG-2, video broadcast 



1 Introduction 



With digital broadcast of video, legal issues of copyright protection have become more important, since the 
inherent decrease of quality of analog video duplication has vanished in digital applications. A favorable method 
of copyright protection is digital watermarking of the multimedia data, i.e., adding a "watermark" (in other 
publications also called "label", "tag" or "signature") that authenticates the legal copyright holder and that 
cannot be manipulated or removed without, at the same time, impairing the multimedia data so much that they 
are of no commercial \-alue any more.^*® Alternatively, an individual watermark might also be included at the 
conditional access unit in the transmitter that encr>-pts the video for the individual receiver in order to identify 
the receiver if he copies and illegally distributes the video, as shown in Fig. 1. While previous publications*" 
do not deal with watermarking in the bitstream domain of coded video, this is an especially interesting topic. 
High-quality MPEG encoding is very complex, in some applications it is even done interactively with fine-tumng 
of parameters by a human operator. Therefore, individual digital watermarking of digital video broadcasted to 
different receivers can be done only after encoding, but before decoding, as shown in Fig. 1. 
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2 Requirements on a digital watermarking scheme for video 

broadcast applications 

following requirements: ^ '""^ broadcast applications should comply with the 

• Th. di,,.., ....™„, ,„„ ^^^^ ^^^^^^^^^^^ 
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• The watermark should be such that it cannot be removed by intentional or unintentional operations on the 
bitstream or on the decoded video without, at the same time, degrading the perceived quality of the video 
so much that it is of no commercial value any more. This requirement is called robustness. 

• For broadcast applications, it can be assumed that the broadcaster will usually store the video in compressed 
format. Therefore, it must be possible to incorporate the watermark into the encoded video, i.e., into the 
bitstream. It is not feasible to decode and re-encode the video for the purpose of watermarking it. 

• Watermarking in the bitstream domain may not increase the bit-rate (at least for constant bit-rate applica- 
tions). This requirement is not obeyed by previous publications dealing with watermarking of still images 
during JPEG compression.' 

• It can be assumed (and it is, in practice, the case) that incorporating a watermark into compressed video 
has to obey much more constraints than incorporating a watermark into uncompressed video. Therefore, it 
is advantageous to do so in the domain of uncompressed video wherever possible. Hence, the watermarking 
algorithm should work interoperable for compressed and uncompressed video with the same type of decoder, 
that is. watermark detector (see Fig. 2). 



3 Digital Watermarking of Raw Video 

The basic idea of watermarking for video is addition of a pseudo-random signal to the video that is below the 
threshold of perception and that cannot be identified and thus removed without knowledge of the parameters of 
the watermarking algorithm. 

Our approach to accomplish this is a direct extension of ideas from direct-sequence spread spectrum commu- 
nications.- The approach in^ is similar and was developed independently. Let us denote 

ay. ay €{-1,1} (1) 

a sequence of information bits we want to hide in the video stream. We then spread this' discrete signal by a large 
factor cr, called the chip-rate, and obtain the spread sequence 

6.* = ay. j-cr<i< [j-^l)'cr (2) 

The spread sequence '6,- is amplified with an amplitude factor a and modulated with a binary pseudo-noise 
senuence 

Pi. Pt€{-l.l} (3) 

The modulated signal, i.e. the watermark u/,* = a • 6,* • pi is added to the line-scanned digital video signal u,- 
yielding a watermarked video signal 

ifi = Vi -h a • bi 'Pi. (4) 

Due to the noisy nature of p,*. u;,* is also a noise-like signal and thus difficult to detect, locate, and manipulate. 
The recovery of the hidden information is easily accomplished by multiplying the watermarked video signal with 
the same pseudo-noise sequence pi that was used in the coder: 

C7 + l)cr-l U + l)'^— 1 U + ^)cr~l 

Sj = 51 Pi • = Pi' + J2 p1 Oc'^i , (5) 

isj'cr i^j-cr i=j-cr 

The first term on the right-hand side of (5) vanishes, if 

(J>l)er-l 

Yl = 0 (6) 

isjcr — 
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(i.e., the pseudo-noise sequence contains as manv - V. • . , r- 

uncorrelated and therefore rP^D— i ^ ^ ^ interval [; - cr . . . (y + i) . 

term ^-=^ - ^' - P^^^ice however, the sum in (6) is not zero, and a correction 

0*+l)-cr-l 

^^-i J2 Pi) -rncanivi), 
which accounts for the different number of -I's and' in th. r. a - 

Ideally becomes i s and 1 s m the pseudo-noise sequence, has to be added, sj then 

0 + l)-cr-l 

^> = XT P.- • t;,- + A ft: cr . a . aj . 

i=j-cr (c) 

and the recovered information bit dj is 

- sign(sj), 

A condition for the scheme to work \<t that ^ j i • , 

wa. used fo. n^oduiation. Th^sr^vt if t .fceive^^^^^^^^^^^^ P-^-- -<,uence is used thee 

wuhout knowledge of the pseudo-noise sequence an" itsTossiWe sSt F^J' . information 
pseudonoise sequence in (3). Non-binarv PN sequences ^e^ L no "M^ s.inphcnv. we have assumed a bi„ar^' 
and are in fact favorable in terms of securitv. G.^LVral " uT« l-^S '"^'^'^""''"^ of the scheme', 
to figure out the unwatermarked pixel value's if th- w^^marn^n^ ? '^f*''""' -atermarks, it is easier 

factor a can be varied according to local properties of ^7^.1 "1'* I's. The amplitude 

-asking effects of the human v'sual system^HV?) i so Tfrr^ corTe r ^P"'^' '^-P^-' 

the robustness of the scheme. Severaf watermark. r,n l?' ""ectmg code can be emploved to increase 

used for modulation. This is due t^the flct that Jf^er nt'pL^^^^^^^^ ''''"^"^ P^^"^---' -^u^ces ^ 

each other and do not significantly interfere.' Pseudo-no.se sequences are in general orthogonal to 

4 Digital Watjermarking of Compressed Video 

i 

into the bitstream (field user.data. can be included Tn anl of ' ''«*°8 incorporated 

Ho.-ever, this is not a suitable means of emb^dfn^ watL^^^^^^ P'^'"- "^^-lers). 

he bustream. Also, adding user data to an MPEG-2 encoTd vi^eTLo '^"'^ ''^ «"PP*d 

key .dea ,s to incorporate the watermark into the sLnaMtself i e nt .1" k"'""""* ^S*'" 
frames. In order to understand how we can adaieve fht we L "e 1 j ^'"''f''? "P^-^'ing the video 

corresponds to the equivalent portion of the bits^«^ I » V * on tow a signal block 

.frame of the sequence for I^ram^^ or torn TprSctS ZTsf^l^^rP I nV^^'*^' -^'-''^5 f«m 
block IS transformed with the DOT, quantized zUT.l Z "^ T V ^""^ S'^^'n^. respectivelv. The 
he (run,Ievel)-pairs. Thus, the blocic of 8 x slk^'S'rSSatt fnto l^r^H "'"r°''^ '"^^ "^--^^ 
followed by a number of VLC codewords representin7( u^teteH ^l^r I J^'"^ representing the DC coefficient 
?r";„ ^^^r^?""' (-".'-eO-cJ^leworSTpiGir^^^^^ J'"" T^'^^i^S position and value of 

encoded v.deo s.gn. block by block. Por each signal btk^tfe 

' ?utcSrt\f fx ^^t;-ratg-^:i^^^^^^ ---- P— se se. 

Denote the OCT coe.cients by with ^ bein^ ^effitrntrd ^i^rS^^^^^^^^^ 
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VLC codeword lengths for (runjevef)-oombtnations 




Figure 3: MPEG-2 VLC codeword lengths for (run.Ievel)-codewords. 



AC-coefficient. Denote the DCT coefficients of the unwaiermarked signal Kn and of the watermarked signal 

2. DC-coefficient: For the DC-coefficient. = Vi + Wq, that is, the mean value of the watermark-block is 
added to the mean value of the signal-block. 

3. AC-coefficients: 'Search the bitstrcam of the coded signal for the next VLC codeword, identify the 
(run.level).pair (r^Jm) belonging to that codeword and, thus, the position and amplitude of the AC DCT 
coefficient Vm represented by the VLC codeword. 

4. = + Wm is the candidate DCT coefficient for the watermarked signal. However, we do also have the 
constraint of not increasing the bit-rate. Thus, we have to check the number of bits we have to transmit for 
the watermarked DCT coefficient 14, versus the bit-rate we have to transmit for the unwatermarked DCT 
coefficient 

5. Lei R be the number of bits used for transmitting the codeword for (r^./^) (iie,. for Vm) and R be the 
number of bits used for transmitting the codeword for (r„,./;) (i.e.. for Vm). (R and R are determined bv 
the VLC-tabics defined in MPEG-2^°). 

6. If the bit-rate shall not be increased and ^ > H (or if the bit-rate of the video may be increased, uncondi- 
tionally), transmit the codeword for (r^,/m). Else, transmit the codeword for (r^,^^). 

7. Repeat steps 3 to 6 until an end.oflblock (EOB) codeword is encountered. 



Due to the bit-rate constraint, usually only few DCT coefficients of the watermark can be incorporated per 8x8- 
block, m a lot of cases (especially for coarse quantization) it might be only the DC coefficient as outlined in step 
2. As a result, the watermarking scheme in the bitstream domain is less robust than its counterpart in the pixel 
domam. In other words: in the bitstream domain, only a fraction of the signal energy of the watermark can 
successfully be embedded. However, for watermarking of video, the chip-rate cr may be chosen to be very high 
mcreasmg the robustness to the desired level, but at the same time decreasing the data rate for the u acermark ' 
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5 Attacks against Watermarks, and Remedies 

a. Addition of a constant offset 

b. Addition of gaussian or non-gaussian noise 

■ c. Linear filtering, e.g. low.pass or high-pass filtering 

d. Nonlinear filtering, e.g. median filtering 

e. Compression, e.g. by hybrid coding schemes like MPEG or H.263 

f- Local exchange of pixels (e.g. permutation of a 2 x 2-block of pixels) 

g. Quantization of the pixel gray values 

h. Rotation of the video frames 

i. Spatial scaling of the video frames 
j. Removal or insertion of single pixels 

k. Removal or insertion of pixel rows or columns 

1. Removal or insertion of video frames 
m. Averaging of several versions of the same video with different embedded watermarks 
n. Single or multiple analog recording on a VCR 

6 Implementation and Simulation Results 

We have implemented the outlined scheme as a C proTam which takes an \iPFr o k;. . 
The p.osram decode, the video and simultaneous.. P^s^'l^ .1^:^^^'^:^^^^^^ 
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pans of the bitstream containing VLC codewords representing DC- and AC-coefficienis of DCT blocks are located 
and replaced by VLC codewords representing DC- and AC-coefficients of the same block plus watermark. Typical 
parameters are q = 1 . . .5 and cr = 10,000 . . . 1. 000^ 000. yielding data rates for the watermark of 1.25 • . . 125 
bytes/second for NTSC TV resolution. The complexity, as shown in Fig- 4. is much lower than the complexity of a 
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Figure 4: Complexity of our watermarking scheme compared to encoding and decoding. 

decoding process followed by watermarking in the pixel domain and re-encoding. For comparison, the complexity 
of decoding alone is also given. Please note that our program, unlike the public domain MPEG coder and decoder, 
has not been optimized for speed yet. Figures 5-7 show an example frame from a video sequence. Fig. 5 shows 



vdl 




Figure 5: Original 

the original frame without compression and a detail from the hand of the table tennis player. Fig. 6 shows the 
same frame after MPEG-2 encoding and decoding and without an embedded watermark. Fig. 7 finally shows 
the compressed frame with an embedded watermark. As can be seen, the watermark results in slightly changed 
pixel amplitudes which are however not visible except in direct comparison to the unwatermarked image. The 
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Figure 6: MPEG-2 coded, without watermark 




7 Conclusions 



\Ve have presented a novel scheme for watermarking of MPEG-2 compressed video in the biistream doma.r. 
Horkmg on encoded rather than on unencoded video is important for practical watermarking applications. The 
scheme is mteroperable and fully compatible with a scheme working in the pixel domain of uncompressed v,de: 
which was also presented. Wuh appropriate parameters, the watermarking scheme in the .MPEG-2 bitstrea- 
domain can achieve neito data rates of several bytes/second while being very robust against unauempted anc 
attempted attacks. The principle can also be applied to other hybrid coding schemes like .MPEG-l. ITU-T U:2e\ 
or IXU-X H.263. 
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